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Abstract 

Models for the behavior of ants and pedestrians are studied in an unified way in this 
paper. Each ant follows pheromone put by preceding ants, hence creating a trail on 
the ground, while pedestrians also try to follow others in a crowd for efficient and 
safe walking. These following behaviors are incorporated in our stochastic models 
by using only local update rules for computational efficiency. It is demonstrated 
that the ant trail model shows an unusual non-monotonic dependence of the aver- 
age speed of the ants on their density, which can be well analyzed by the zero-range 
process. We also show that this anomalous behavior is clearly observed in an ex- 
periment of multiple robots. Next, the relation between the ant trail model and the 
floor field model for studying evacuation dynamics of pedestrians is discussed. The 
latter is regarded as a two-dimensional generalization of the ant trail model, where 
the pheromone is replaced by footprints. It is shown from simulations that small 
perturbations to pedestrians will sometimes avoid congestion and hence allow safe 
evacuation. 
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1 Introduction 



Modelling of self-driven particles is a recently progressing research area in 
physics, and opens a new paradigm in statistical physics [1,2]. Self-driven par- 
ticles, such as vehicles, pedestrian and ants, do not necessarily satisfy Newton's 
third law, i.e., the law of action and reaction. This is mainly because the force 
acting among such particles has a psychological or social origin, and hence the 
reaction differs from one individual to another. Therefore the behavior of these 
particles is not well described by the usual framework of mechanics or (equi- 
librium) statistical physics. Nevertheless in the case of collective motion, some 
aspects of the behavior have similarities with those seen in Newtonian par- 
ticles, such as phase transitions, cluster formation and occurrence of domain 
walls [1,2]. 

There are several attempts to describe such self-driven particles for the last 
several decades, ranging from differential equations with some social forces 
[3,4], to cellular automaton (CA) models with various update rules [5,2]. In 
this paper, we show modellings of ants and pedestrians by a cellular automaton 
approach in an unified way. We demonstrate similarities between ants on a trail 
and pedestrians in evacuations, since both try to follow others through sniffing 
pheromone on a trail, and information from one's eyes and ears, respectively. 
The behavior of pedestrians is usually not simple in normal situations, but in 
emergency cases like evacuation from a building on fire, people rush to exits 
and only simple motions are observed. In this paper we restrict ourselves to 
the case of evacuation in the modelling of pedestrians. For this case, we show 
that human behavior can be modeled by a naturally extended model of ants. 

The paper is organized as follows. In Sec. 2, we introduce our model of traffic 
of ants on a trail, and discuss its dynamical properties such as loose cluster 
formation and anomalous flow-density relation by using a solvable stochas- 
tic model. We have also performed an experiment on our ant trail model by 
developing a multiple robots system. In Sec. 3, a stochastic model of pedes- 
trian dynamics is presented, which is called the floor field model. We discuss 
the relation of the floor fleld model and the ant trail model, and show simu- 
lated results of the model by taking into account the inertia of pedestrians. 
Concluding remarks and future problems are given in Sec. 4. 
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2 Traffic of ants 



2.1 Ant trail model 

Let us first define the ant trail model (ATM) which is a simple model for 
an unidirectional motion of ants on a trail. The ants communicate with each 
other by dropping a chemical called pheromone on the substrate as they move 
forward [6] . The pheromone sticks to the substrate long enough for the other 
following ants to pick up its smell and follow the trail. 

First we divide the one-dimensional trail into L cells, each of which can accom- 
modate at most one ant at a time. We will use periodic boundary conditions, 
that is, we consider an ant trail of a circuit type. The lattice cells are labeled 
by the index i [i = 1,2, and wc associate two binary variables Si and 

CTj with each site i. Si takes the value or 1 depending on whether the cell is 
empty or occupied by an ant. Similarly, CTj = 1 if the cell i contains pheromone; 
otherwise, CTj = 0. Since a unidirectional motion is assumed, ants do not move 
backward in this model. Their hopping probability becomes higher if it smells 
pheromone ahead of it. The state of the system is updated at each time step 
in two stages. In stage I, ants are allowed to move, and stage II corresponds to 
the evaporation of pheromone. In each stage the dynamical rules are applied 
in parallel to all ants and pheromones, respectively. 

Stage I: Motion of ants 

An ant at cell i that has an empty cell in front of it, i.e., Si{t) — 1 and 
Si+i(t) = 0, hops forward with probability Q if (Tj+i(t) = 1 and q if (Ti^i{t) = 0. 
Here we assume g < Q for consistency with real ant-trails where pheromone 
works as an attractive chemical for ants on a trail. 

Stage II: Evaporation of pheromones 

At each cell i occupied by an ant after stage I a pheromone will be created, 
i.e., o"j(t + 1) = 1 if Si{t -\- 1) = 1. On the other hand, any free pheromone at 
a site i not occupied by an ant will evaporate with the probability / per unit 
time, i.e., if Si{t -|- 1) = 0, ai{t) = 1, then ai{t + l) = with probability / and 
(Ji(t + 1) = 1 with probability 1 — /. 

The rules can be written in a compact form as the following coupled equations: 



Sj{t + l) = Sj{t) + min(r7,_i(t), Sj^i{t), 1 - Sj{t)) 

- mm{r]j{t), Sj{t),l- Sj+i{t)), 
(7j + 1) = max{Sj (t + 1) , mm{aj {t) , (t) ) ) , 




(2) 
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where ^ and f] are stochastic variables defined by ^j{t) = with probabihty 
/ and ^j{t) = 1 with probabihty 1 — /, and Tij(t) = 1 with probabihty p = 
Q + (Q ~ (l)^j+i{t) and r]j{t) = with probabihty 1 — p. We point out that 
eqs. (1) and (2) reduce to the asymmetric simple exclusion process (ASEP) 
[7], which is one of the exactly solvable models, if p is a constant, i.e., p does 
not depend on a. If we further consider the deterministic limit p = 1, then 
this model reduces to the Burgers CA [8], which is also exactly solvable. 

2.2 Numerical results 

The ASEP with parallel updating has been used often as a simple model of 
vehicular traffic on single- lane highways [5]. The most important quantity of 
interest in the context of fiow properties of the traffic models is the fundamen- 
tal diagram, i.e., the flow-versus-density relation, where flow is the product of 
the density p and the average speed V. Thus it is interesting to compare the 
fundamental diagram of the ATM with that for vehicular traffic. 




Fig. 1. The average flow (a), speed (b) of the ants are plotted against their densities 
for the parameters Q = 0.75, g = 0.25 and L = 500. The discrete data points cor- 
respond to / = 0.0005(0), O.OOl(o), 0.005(«), 0.01(A), 0.05(n), O.lO(x), 0.25(+), 
0.50(*). The cases / = and / = 1 are also displayed, wliich are identical to the 
ASEP corresponding to the effective hopping probabilities Q and q, respectively. 

Numerical results of the fundamental diagrams of the ATM is given in Fig. 1(a). 
The density-dependence of the average speed of the ATM is also shown in 
Fig. 1(b). We first observe that the diagram does not possess particle-hole 
symmetry. In the ASEP the flow remains invariant under the interchange of 
p and 1 — p; this particle-hole symmetry leads to a fundamental diagram that 
is symmetrical about p = |. In the ATM, particle-hole symmetry is seen in 
the special cases of / = and f — 1 from Fig. 1(a). In these two special 
cases the ant-trail model becomes identical to the ASEP with parallel updat- 
ing corresponding to the effective hopping probabilities Q (for f — 0) and q 
(for f — 1), respectively. 

Next, over a range of small values of /, it exhibits an anomalous behavior 
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in the sense that, unUke common vehicular traffic, V is not a monotonically 
decreasing function of the density p (Fig. 1(b)). Instead a relatively sharp 
crossover can be observed where the speed increases with the density. In the 
usual form of the fundamental diagram (flow vs. density) this transition leads 
to the existence of an inflection point (Fig. 1(a)). 

By a detailed study of the spatio-temporal behavior in the steady-state, we 
were able to distinguish three different density regimes [9]. At low densities 
a loosely assembled cluster is formed and propagates with the probability q 
(Fig. 2). The leading ant in the cluster which hops with probability q will de- 
termine the velocity of the cluster. Homogeneous mean field theories fail in this 
region since these theories always assume that ants are uniformly distributed, 
which is not true in the case of the ATM [9] . 



Fig. 2. Spatial-temporal behaviors of loose clusters in the low density case (p = 0.16). 
Parameters are Q = 0.75, q = 0.25, / = 0.005. We see the loose clusters emerge from 
the random initial configuration, which will eventually merge after sufficiently long 
time into one big loose cluster. 



In the intermediate density regime, the leading ant occasionally hops with 
probability Q instead of q, because it becomes possible to feel the pheromone 
which is dropped by the last ant in the preceding cluster. This arises from the 
fact that, due to the periodic boundary conditions, the gap size between the 
last and leading ant becomes shorter as the cluster becomes larger, so that 
the leading ant is likely to find the pheromone in front of it. This increase of 
the average speed in this intermediate-density region (Fig. 1(b)), leads to the 
anomalous fundamental diagram. 

Finally, at high densities, the mutual hindrance of the ants dominates the 
flow behavior leading to a homogeneous state similar to that of the ASEP. 
In this regime the loose cluster does no longer exist and ants are uniformly 
distributed after a long time. Thus homogeneous mean field theories give a 
good result in accounting the fundamental diagram only in this regime [9]. 
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2.3 Analytical results 



The ATM is closely related to the zero-range process (ZRP), which is known as 
one of the exactly solvable models of interacting Markov processes [10,11]. The 

ZRP consists of the moving particles of the exclusion process. The hopping 
probability of a particle depends on the number of cells to the particle in 
front. Hence the ZRP is regarded as a generalization of ASEP. In the ATM, 
the hopping probability u can be expressed as 



u^q{l-g) + Qg, 



(3) 



where g{x) = (1 — f)^^^ (Fig- 3). Assuming that a gap size of successive ants 
is X, g represents the probability that there is a surviving pheromone on the 
first site of a gap [12]. Thus, since in the ATM the hopping probability u is 
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Fig. 3. Hopping probability versus the number of cells between successive ants. 
Parameters are Q = 0.75, q = 0.25, / = 0.1 and = 1 in (3). 

related to x, we may utihze the exact results for the ZRP [11]. The average 
velocity V of ants is then calculated by 



L-M 

V = ^ u{x)p{x) 



(4) 



x=l 



where L and M are the system size and the number of ants respectively (hence 
p — M/ L is the density) , and p{x) is the probability of finding a gap of size 
X, which is given by 



p{x) — h{x) 



Z{L 



X 



1,M-1) 



Z{L,M) 



(5) 
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Since the ATM is formulated with parallel update, the form of h{x), as calcu- 
lated in (5), is given by [13] 



l-u(l] 



h{x) = { l-u{l) 1 - u{y) 



for X = 
for a; > 



(6) 



The partition function Z is obtained by the recurrence relation 



L-M 



Z{L, M)= Z{L-x-l, M - 



(7) 



x=0 



with Z{x, 1) = h{x — 1) and Z{x,x) = {h{0)}^, which is easily obtained by 
(5) with the normalization Y^p{x) = 1. 
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Fig. 4. The fundamental diagram of the ATM with the parameter L = 200. Param- 
eters are Q = 0.75, q = 0.25,/ = 0.005. The smooth thin curve is the theoretical 
one, while the zigzaged thick one is the numerical data. 

Next we draw the fundamental diagram of the ATM by using (4) and changing 
p from to 1. It is given in Fig. 4 with L = 200. The thick black curve is 
the numerical data and the smooth thin black one is the theoretical curve in 
each figure with the specified value of L. We see that the theoretical curves 
are almost identical to the numerical ones, thus confirming that the steady 
state of the ATM is described by the ZRP. 



2.4 Multiple robots experiment 



Next we set up an experimental system of our ant model by using multiple 
robots that can communicate with each other through pheromone-like inter- 
action. In this experiment, a virtual pheromone system (V-DEAR) [14] was 
introduced, in which chemical signals are mimicked by the graphics projected 
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on the floor, and the robots decide their action depending on the color infor- 
mation of the graphics. 




Fig. 5. A schematic view and photo of V-DEAR. (a) The system is composed of 
Liquid Crystal Projector to project the Computer Graphics and the CCD camera 
to trace the position of the robots in the field, (b) Each robot has sensors on the 
top to detect the color and brightness of the field. 



Fig. 5 shows the schematic and photo of V-DEAR. Each robot moving on the 
field detects the color and brightness of the field from sensors on the top, and 
determines its actions autonomously based on the conditions of the Computer 
Graphics (CG) on the fioor. Combining the position information of the robots 
acquired from the CCD camera and the projected CG by the projector, we 
can achieve the dynamic interaction between the environment and robots. 

Each robot leaving a pheromone moves in the same direction on the circum- 
ference of a circle with diameter 520 mm (Fig. 6, left). The robot immediately 
behind it traces the pheromone, hence it follows the leader. The speed of each 
robot v{x) is given by 

Vq for p{x,t) >pth 
v{x) = { (8) 
Vg for p{x, t) < pth 



where x is the position on the circumference, p{x, t) is the concentration of 
pheromone at the position and pth is a constant (Fig. 6, middle). If a robot 
catches up with the robot in front, then the robot in the rear stops moving 
for 1 sec (Fig. 6, right). 
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Marking Tracing Collision 



Fig. 6. Interactions between robots through the color CG projected on the floor. 
Marking, tracing and collision are schematically depicted. 

The dynamics of the virtual pheromone is described as 

— — = P-fp{x,t), (9) 

where / is the rate of evaporation and P the injection concentration given 
hj P = Pq if a robot exists at x, and P = if not. p{x,t) is expressed 
by the gradation of the white color CG which ranges from to 255. In this 
experiment, we set Vq = 7 cm/s, Vq = 1.4 cm/s, pth = 127, and Pq = 250. 

The experiment was carried out with groups of 4 to 17 robot teams, with 
/ = 0, 0.03, 0.05 and 1.00. All experiments were performed one time and had 
a duration of 3 minutes. As initial condition, robots were distributed evenly 
on the circle. 




Fig. 7. Loose cluster formation by six robots on a circle. 

Fig. 7 shows an example of loose cluster formation of robots in this exper- 
iment. The maximal group size of robots on the circumference is 22, hence 
Fig. 7 corresponds to a density of 6/22. Flow is defined as the number of 
robots crossing a fixed point on the circumference during the experimental 
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Fig. 8. Fundamental diagram of the robots experiments for / = 0,0.03,0.05 and 1. 
We sec that the velocity increases sharply for the small but finite values of /, which 
is similar to fig.l. 

duration. The fundamental diagram of our experiment is given in Fig. 8. It 
shows anomalous features very similar to Fig. 1, although the robot exper- 
iment is subject to various perturbations. Prom Fig. 8 the average velocity 
surely increases only in the small / cases. Thus we confirm in this experiment 
that our finding on the anomalous behavior in the ATM is robust and may 
happen in nature if the evaporation rate of pheromone is sufficiently low. 



3 Modelling of evacuations 



3. 1 Floor field model 



We consider a model for pedestrians in evacuation in this section by using a 
cellular automaton approach. The model is called the floor field model [15] 
(FFM), which is successfully used up to now for modelling panic behavior of 
people evacuating from a room. The two-dimensional space is discretized into 
cells of size 40 cm x 40 cm which can either be empty or occupied by one 
pedestrian. Each pedestrian can move to one of the unoccupied Neumann- 
neighbor cells or stay at the present cell at each time step t ^ t + 
1 according to certain transition probabilities pij as explained below. The 
important step for this model is to introduce two kinds of floor fields: The 
static floor field S describes the shortest distance to an exit door. The field 
strength Sij is set inversely proportional to the distance from the door. The 
other one is the dynamic floor field D, which is a virtual trace left by the 
pedestrians similar to the pheromone in chemotaxis. It has its own dynamics, 
namely diffusion and decay, which leads to broadening, dilution and finally 
vanishing of the trace. 

The update rules of the FFM have the following structure: 
(1) The dynamic floor field D is modified according to its diffusion and decay 



10 



rules, controlled by the parameters a and b. 

(2) For each pedestrian, the transition probabilities p.^ for a move to an 
unoccupied neighbor cell are determined by the two floor fields. 
The values of the fields D (dynamic) and S (static) are weighted with 
two sensitivity parameters ko and ks'- 

Pij ~ exp (koDij) exp {ksSij)Pi{i, (10) 

Here Pj represents the inertia effect [16] given by Pi{i,j) = exp {kj) for 
the direction of one's motion in the previous time step, and Pr{i,j) — 1 
for other cells, where kj is the sensitivity parameter, is responsible for 
the exclusion in a cell; if the target cell is occupied by another pedestrian 
or an obstacle, then we set = 0, while = 1 if it is free. 

(3) Each pedestrian chooses randomly a target cell based on the transition 
probabilities pij determined by (10). 

(4) Whenever two or more pedestrians attempt to move to the same target 
cell, the movement of all involved particles is denied with probability 
IJ, e [0, 1], i.e. all pedestrians remain at their site. Which one is allowed 
to move is decided using a probabilistic method [17]. 

(5) The pedestrians who are allowed to move perform their motion to the 
target cell chosen in step 3. D at the origin cell of each moving 
particle is increased by one: I?^ D^j + 1. 

The above rules are applied to all pedestrians at the same time (parallel up- 
date) . 

Let us now briefiy explain the similarities between the FFM and the ATM. 
Considering a one-dimensional variant of the FFM, the hopping probability 
(10) of moving forward for a pedestrian at cell i is simply written as pi ~ 
exp{kDP>i+i), where i^j+i is the number of footprints at the next cell i + 1. 
Here assuming a unidirectional motion of pedestrians, the static fioor field 
and inertia can be omitted in (10). Thus the FFM takes into account the 
concentration of multiple pheromones, i.e., footprints at a cell. In the ATM, 
Pi takes only two values, Q and q, depending on -Dj+i = 1 or respectively. 
Thus if we restrict the binary values for D as D ^ min(l, D), then the one- 
dimensional FFM directly corresponds to the ATM if we choose the hopping 
probability as 

= gexp(A;Dmin(l, A+i)) (11) 



where k^ — InQ/q. 
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3.2 Model parameters and their physical relevance 

There are several parameters in the FFM which are hsted below with their 
physical meanings. 

(1) ks G [0, oo) ■ ■ ■ The coupling to the static field characterizes the knowl- 
edge of the shortest path to the doors, or the tendency to minimize the 
costs due to deviation from a planned route. 

(2) ko e [0, oo) ■ ■ ■ The coupling to the dynamic field characterizes the ten- 
dency to follow other people in motion {herding behavior). The ratio 
kn/ks may be interpreted as the degree of panic. It is known that people 
try to follow others particularly in panic situations [3]. 

(3) ki e [0, oo) ■ ■ ■ This parameter determines the strength of inertia which 
suppresses quick changes of the direction of motion. It also refiects the in- 
dividual's tendency to avoid unnecessary acceleration of the speed during 
walking. 

(4) jj, G [0, 1] ■ ■ ■ The friction parameter controls the resolution of confiicts 
in clogging situations. Both cooperative and competitive behavior at a 
bottleneck are well described by adjusting /j, [18]. 

(5) a,6 E [0, 1] ■ ■ ■ These constants control diffusion and decay of the dynamic 
fioor field. It refiects the randomness of people's movement and the visible 
range of a person, respectively. If the room is full of smoke, then 6 takes 
large value due to the reduced visibility. 



3.3 Simulations 

We focus on measuring the total evacuation time by changing the parameter 
kj. The size of the room is set to 100 x 100 cells. Pedestrians try to keep their 
preferred velocity and direction as long as possible for minimizing their effort. 
This is taken into account by adjusting the parameter kj. In Fig. 9, total 
evacuation times from a room without any obstacles are shown as function of 
/cd in the cases kj — and ki — 3. We see that it is monotonously increasing in 
the case kf — 0. This is because any perturbation from other people becomes 
large if /c/j increases, which causes the deviation from the minimum route. 
Introduction of inertia effects, however, changes this property qualitatively, 
and the minimum time appears around /cd = 1 in the case kj = 3. This is well 
explained by taking into account the physical meanings of ki and ko- If kj 
becomes larger, people become less flexible and all of them try to keep their 
own minimum route to the exit according to the static floor fleld regardless of 
congestion. For the (unrealistic) case of very large values of kj their motion 
will be completely determined by inertia and thus they might not be able to 
flnd the exit at all. By increasing ko, disturbances from other people become 
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relevant through the dynamic floor fleld. This perturbation makes one flexible 
and hence contributes to avoid congestion, especially at the exit. Large 
again works as strong perturbation as in the case of kj = 0, which diverts 
people from the shortest route largely. Note that if we take sufficiently large 
ki, then the effect oi kn becomes relatively weak and smooth evacuation will 
be prevented due to the strong clogging at the exit. 
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Fig. 9. Total evacuation time vs. coupling ko to the dynamic floor field for different 
values of kj. The room is a simple square without obstacles and 50 simulations arc 
averaged for each data point. Parameters are p = 0.04, ks = 2, a = 0.2, 6 = 0.2 and 
= 0. 



4 Conclusion 

In this paper, we have studied simple models for ants and pedestrians in an 

unifled way. Ants on a trail follows phcromone dropped by its preceding ants, 
and pedestrians also follow others in a crowded or panic situation mainly for 
safe and efficient reasons. We have proposed stochastic cellular automaton 
models of both ants on a trail and pedestrians in evacuation. 

The ant trail model shows an anomalous flow-density relation, which can be 
analyzed by a ZRP. We have shown that this behavior is also seen in an 
experiment of multiple robots. It is interesting to see whether the fundamental 
diagrams remains anomalous when we introduce more then two velocities in 
(8) . Since the velocity of ants in reality allows more gradations, it is important 
to test how robust the anomaly predicted by the simple model is. 

Some generalizations of the ATM have been recently studied: For open bound- 
ary conditions, we have a similar phase diagram where the critical point de- 
pends on the evaporation probability / [19]. A simple bidirectional general- 
ization is also proposed in [20]. It is interesting to compare the fundamental 
diagram recently obtained in an experiment with bidirectional leaf-cutting 
ants [21] with that of the bidirectional model. The FFM can be regarded as a 
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two-dimensional generalization of the ATM, where the pheromone is replaced 
by footprints. By using the FFM it is shown that the small perturbation to 
pedestrians can reduce the total evacuation time in some cases. 

Finally, it is interesting to study how a trail of ants between their nest and a 
food source is created by extending the ATM to two spatial dimension. Then 
we can directly compare the behaviors of ants and pedestrians by using the 
two models, and hopefully we will find good strategies of evacuation from the 
behaviors of ants that have "swarm intelligence" [22] . 
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